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Abstract 


We provide evidence for the robustness of the notion of universality (introduced by 
[AB92] for the class MV). The natural NP-relations that define certain NP-complete 
problems like Graph fe-Coloring are not immediately amenable to the formalism of 
[AB92] for proving their universality. In this thesis, we prove universality of such 
languages. In particular for the NP-complete problems: Graph A:-Coloring (for 
A; > 3), A:-NM Colorability (for A: > 3), Learning of A:-DNF formulae (for k > 3), 
and Generic NP-complete problem. Later, we extend this notion to the complexity 
class 1-NL. 1-NL is the class of languages accepted by non-deterministic turing 
machines having one-way read-only input tape and logarithmic worktape. We define 
1-NL languages in terms of 1-NL relations and then give a characterization of 1-NL 
universality. Finally, we present our work on POP, which gives a different account 
for the class AfV and defines a very different natural NP-relations. We sketch the 
proof of the PCP theorem J^fV = PCP(logn, 1), which will later help us in proving 
the relation witnessing 3SAT as per PCP to be universal. 
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Chapter 1 


Introduction 


The notion of universality was introduced by Agrawal and Biswas ([AB92]) for the 
dass J\fV, where they observed the structural similarities in natural NP-complete 
sets and found that the usual reductions among them are solution preserving, viz., 
when a language Li reduces to an NP-complete language L 2 via such a solution 
preserving polynomial-time many-one reduction /, then we can easily extract the 
solutions of the instance x €. Li from the solutions of the corresponding instance 
jf(rr) G 1/2- A solution for an instance is the witness that the instance belongs to 
a set 5. Every MV set S can be seen to be associated with an NP-relation Rs, 
Jls being {{x,y) | a: G 5 and y a witness that shows x to be in 5}. A relation Rs 
for S is called universal if S is NP-complete under solution preserving reductions. 
Tinally, [AB92] also characterized universal relations and gave an easy way to prove 
a, set to be NP-complete by showing the two properties (joinability and couplability) 
liold for Rs and one particular instance called building block exists. Some relations 
■witnessing natural NP-complete problems are not universal by the above character- 
ization, so [AB92] generalized the universality notion to near-universal, and showed 
that these relations are near-universal. 

Further, [AB92] proved several relations witnessing natural NP-complete problems 
to be universal by showing them joinable, couplable and having a building block. 
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Some proofs are easy to construct than the ones which are obtained using usual re- 
ductions. The Graph Isomorphism problem is not believed to be NP-complete and 
[AB92] gave further evidence by showing the standard relation witnessing it to be 
not near-universal. Apart from the universality proofs of several relations witness- 
ing natural NP-complete problems, [AB92] also proved that the relations witnessing 
non-natural sets like k-creative sets ([JY85]) are universal. 


1.1 Thesis 

In this thesis, we prove the relations witnessing certain NP-complete problems to be 
universal in order to give evidence for the robustness of universality notion. Later, 
we extend this notion to the complexity class 1-NL and finally, we present our 
attempt towards PCP-universality. 

1.1.1 Graph 3-Coloring 

Graph 3-Coloring is a natural NP-complete graph problem, but the usual notion 
of couplability in its standard witnessing relation is not definable here due to the 
following reason. In most of the graph problems, a solution string encodes either 
vertices or edges indicating their presence or absence in the witness. Therefore, the 
meaning of coupling two bits in their corresponding relations is to enforce the con- 
dition that exactly one of the two vertices (or edges) represented by these two bits 
is present in the solution string. In the case of Graph 3-Coloring, a natural way to 
encode three colors is by using two bits for each color in the solution string. There- 
fore, coupling of any two bits in the solution string does not make any sense here. 
The natural meaning should be to couple the colors of two vertices, but according 
to the definition of couplability, it has to be a function that can couple any two bits 
in the solution string. 

In chapter 2, we modify the definition of couplability for the relation witnessing 
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Graph 3-CoIoring problem to show that this relation is near-universal. In the simi- 
lar way, we can obtain the proof of universality for the standard relation witnessing 
Graph fc-Coloring problem for any k > 3. Next, we show the universality of the 
relations witnessing some other problems including A:-NM colorability (for k > 3), 
Learning of A:-DNF formulae (for k >3), and Generic NP-complete language. 

1.1.2 1-NL 

The notion of universality has also been defined in the similar fashion for the com- 
plexity classes //C ([CSB04]), and #7^ ([CK03, FM03]). In chapter 3, we define this 
notion for the class 1-NL. 

1-NL (1-L) is the class of languages accepted by non-deterministic (deterministic) 
Turing machines having one-way read-only input tape and logarithmic worktape. 
The classes L and NL axe different from these classes, where the machines have two- 
way read-only input tape. 1-NL is computationally more powerful than 1-L and it is 
interesting to note that although it is computationally very weak than NL, yet any 
complete set for it under 1-L reductions is also complete for NL under L reductions 
([HM81]). We know from the Immerman-Szelepcsenyi result that NL is closed un- 
der complementation ([ImmSS]), however 1-NL is not closed under complementation 
(IHU671). 

Like NL in [CSB04], we define 1-NL languages in terms of relations and then char- 
acterize 1-NL universal relations. The notion of universality for 1-NL gives a good 
understanding of it. This class is important because if a 1-NL complete problem 
can be shown in L, then the space bounded deterministic and non-deterministic 
computations for space ©(logn) collapses (i.e. L=NL). 

1.1.3 PCP 

PGP stands for Probabilistically Checkable Proofs. It denotes the class of lan- 
guages accepted by PCP machines, which consist of a probabilistic polynomial time 
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verifier (a machine) with a read-only input tape (input is on this tape), a random 
tape (contains random bits used by the verifier), a proof tape (contains proof string 
provided by the prover for the input) and a work tape (the verifier does cornpu- 
tations on this tape). PCP machines are classified by two resources, the number 
of random bits used by the verifier and the number of query bits read from the 
proof string. A verifier is said to be (r(n), 5 (n))-restricted if it uses 0(r(n)) random 
bits and queries 0{q{n)) bits from the proof string, and a language L belongs to 
the class PCP(r(n),Q'(n)), if the membership proofs for L can be checked by an 
(r(n), g'(n))-restricted verifier. According to this classification, NP contains exactly 
those languages for which membership proofs can be checked by a (logn, l)-restricted 
verifier. The PCP theorem states the equivalence of NP and PCP (logn, 1) (for fur- 
ther details, see {Aro94, AS92, RS95, DKOO, ALM'^'92, Sud92, KumOS]). 

PCP gives a different account for the class NP as it defines a very different nat- 
ural NP-relation. Therefore, it would be interesting to see whether the technique 
of universal relations defined for the classical NP-relations is also applicable to the 
NP-relations defined as per PCP. In chapter 4, we analyze the proof string through 
the sketch of the PCP theorem in order to understand the new definition of NP and 
later show that the relation witnessing 3-SAT as per PCP is universal. 

1.2 Definitions and Important Results 

These definitions and results are directly taken from [AB92] and the relations in 
these definitions are assumed to be NP-relations. 

Definition 1.1 Function /, /: E* — > S*, is a solution preserving reduction of rela- 
tion Q to relation R if it is polynomial-time computable and satisfies the following 
conditions. 

1. f{x) = {z, a) where rr, z 6 E* and a is a sequence with ja| = sol-lenQ{x). 

2. projaisolniz)) = soIq{x). 
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)efinition 1.2 Relation R is a universal relation if for every relation Q, there is a 
jlution-preserving reduction of Q to R. 

*roposition 1.1 If R is a universal relation then Lr is NP-complete under polynomial- 
ime honest reductions. 

lefinition 1.3 3-SAT: Given a formula where is conjunction of clauses, and 
ach clause has three literals, the problem 3SAT is to determine whether V' is satis- 
iable. 

The relation Rssat is: {iP)Rssat{s) iff s is a satisfying truth assignment for •0. 
Proposition 1.2 Relation Rzsat is universal. 

1.2.1 Characterization of Universal Relations 

Definition 1.4 Relation R has a building block if there is an element in Lr, blockR, 
ind three positive integers biti, bit 2 , and bits such that 

projbitiMt2,bitzisolRiblockR)) = _ {qOO}. 

Definition 1.5 Relation R is joinable if there exists a polynomial-time computable 
function joinR, joiuR : S* — > E*, satisfying the following conditions. 

1. joinR{{xi, ..., Xn)) = {z, a) where Xi, ..., Xn, z € E* and la| = I!,'^^-ySol-lenR{xk). 

2. proja{solR{z)) = {siS2 ■ • • Sn I (VA: < n)sk G solR{xk)}. 

Definition 1.6 Relation R is couplable if there exists a polynomial-time computable 
function cplR, cplR : S* — > E*, satisfying the following conditions. 

1. cplR{x,{ii, ...,in), {ji, ...,jn)) = {z,a) where x 6 E*,l < ii,...,inji, -Jn < 
sol-lenR{x), ijn ^ jm for each 1 < m < n and |q;1 = sol-lenR[x). 

2. proja{solR{z)) = {s|s € soIr{x) and (Vm < n) ^ 

Proposition 1.3 Relation R is universal iff R is joinable, couplable and has a build- 
ing block. 
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i Near-Universality 

lition 1.7 Relation R is a refinement of the relation R if there is a polynomial- 
computable many-one function h, h : S* — > S*, such that for every x and s, 
on h satisfies the following conditions. 

For every s, h~^{s) is either 0 or contains s. 
vRh{s) xRs. 

ition 1.8 Relation R is near-universal if there is a refinement R oi R such 
’ is universal. 

)sition 1.4 Set S has a near-universal relation iff it has a universal relation. 
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Chapter 2 


NP Universality Results 


As we stated in the introduction, the usual notion of couplability does not make 
sense for the standard witnessing relation of Graph 3-Coloring. A solution string of 
the Graph 3-Coloring instance is an encoding of colors assigned to all the vertices 
in the graph and a natural way to encode three colors is by using two bits for each 
color. Therefore, coupling of any two bits in the solution string does not malce any 
sense here. The natural meaning should be to couple the colors of two vertices, but 
according to the definition of couplability, it has to be a function that can couple 
any two bits in the solution string. 

In this chapter, we modify the definition of couplability for the relation witness- 
ing Graph 3-Coloring problem to show that this relation is near-universal. In the 
similar way, we can obtain the proof of universality for the standard relation wit- 
nessing Graph fc-Coloring problem for any k > 3. Next, we show the universality of 
the relations witnessing some other problems including A;-NM colorability (for k > 
3), Learning of /c-DNF formulae (for k >3), and Generic NP-complete language. 

2.1 Graph 3- Coloring 

First we show that the standard relation witnessing Graph 3-Coloring problem is 
near-universal and then apply the same technique to Graph fc-Coloring for all k>3. 
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Definition 2.1 Graph 3-Coloring: Given a graph G = (V, E). The problem is to 
tell whether G is 3-colorable, that is, does there exist a function f : V {1,2,3} 
such that f{u) ^ f{v) whenever {u,v} € E. 

The relation Rose is: {G)Rg 3 c{s) iff s encodes the colors assigned to vertices 
of G such that the above property satisfies. Without loss of generality, we as- 
sume that the three colors {1,2,3} are encoded in the following binary strings 
{11,01,00} respectively. For example, let G = {V,E) and V = {vi,V 2 ,-.,Vn), then 
s = c(vi)c(v 2 ) • • ■ c(u„), where c{vi) is the color encoding assigned to the vertex Vi 
(i.e. c: {11,00,01}). 

Theorem 2.1 Relation Rase Is near-universal. 

Proof: Notice that Raze has many redundant solutions. We say that two so- 

lutions are same if we can map the colors in one solution to the colors in another 
solution by a one-to-one mapping o : {1, 2, 3} — > {1, 2, 3}. Therefore, a solution can 
be represented by six different colorings, and hence six different solution strings. 

First we refine this relation to remove the above redundancy in the solution strings 
to some extent. In the refined relation, first vertex of the graph is always assigned 
color 1, which has encoding Tl’ in the solution string. Therefore, every solution 
string in the refined relation starts with 1 in its MSB position. Note that this re- 
finement reduces many redundant solutions, however not completely, but now there 
are only two different solution strings representing the same solution. Let Raze is 
the relation after refinement. Now we show the solution preserving reduction from 
RzSAT to Rg3C- 


We follow the reduction from 3SAT to Graph 3-Coloring as given in [CLR90]. From 
the given formula ■0 of m clauses and n variables {xi,X 2 , we construct a 

graph G = (V, E) as follows: The set V consists of a vertex for each variable, a 
vertex for negation of each variable, five vertices for each clause and three special 
vertices. These three special vertices are labeled as true, false, and red. The edges 
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the graph are of two types: one independent of the clauses and one dependent 
the clauses. The independent of the clauses edges form a triangle on the special 
rtices and also form a triangle on Xi, -iXj, and red for 1 < i < n. 

le triangle on the special vertices enforces the assignment of different colors to 
ch of the special vertex and the triangle on Xi, ->Xi, and red for 1 < i < n enforces 
at exactly one of the variable and its negation is colored with c{true), other is 
lored with c{false), and they can not be colored with c{red). The idea is that the 
riables, whose corresponding vertices are colored with c{true), will get value 1 and 
e remaining variables will get value 0 in the truth assignment of the formula ip. 
t enforce the conditions corresponding to the clauses, for each clause, we have five 
tra vertices and they are connected in such a way, so that at least one literal of 
e clause will get value 1 (for satisfying the clause). For example, the construction 
widget corresponding to the clause {xVyV z) is shown in figure 2.1. 

lus for every instance ip of 3SAT, we have an instance G = (V, E) of Graph 3- 
)loring such that for every truth assignment of ip, there is a 3-Coloring of G. 

le solutions of 3SAT instance can be obtained from the solutions of corresponding 
raph 3-Coloring instance as follows: 

ithout loss of generality, we assume that G is outputed as follows: the initially 
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the three special vertices {true, false, red), then n vertices corresponding to the n 
variables, then n vertices corresponding to the negation of variables, then vertices 
corresponding to the m clauses, i.e. V — {true, false, red,Xi, ...,Xn, ..., -'Xn, ■■■), 

and fin all y all the edges of G. Observe that, the true labeled vertex is outputed as 
the first vertex in the graph, so in every solution, it is assigned the color encoded as 
‘ir. The solutions of Graph 3-Coloring instance are encodings of colors assigned to 
each vertex and the solution length is 2 ♦ jVl- The projection sequence is just the 
sequence of the first bits of the colors assigned to the vertices corresponding to the 
variables (positive literal), i.e. a = 7,9, ..., 2n + 5 and |q:| = n. 

Therefore, the variables, whose corresponding vertices axe colored with c{true), are 
assigned value 1, and the remaining variables, whose corresponding vertices are col- 
ored with c{false), are assigned value 0 regardless of the color encoding given to 
c{false), because the first bit of both the color encodings {00, 01} is 0. This assign- 
ment satisfies the formula ip, which is trivial to see from the reduction. 

As we already know that Rzsat is universal, therefore, Rqzc is universal from the 
above solution preserving reduction. Hence, Rgzc is near-universal. | 

Theorem 2.2 Relation Raze is universal using characterization of universal rela- 
tions ([AB92J). 

Proof: We prove that ^zc is universal by showing that Raze is joinable, cou- 

plable and has a building block. We assume that the graph G = {V,E) has n 
vertices, and they are labeled as numbers from 1 to n. 

For the building block, the graph G = {V,E), where V = (1,2, ..., 13) is given 
in figure 2.2. The solution string s consists of the color encodings assigned to all the 
vertices in the same order as given in V (i.e. s = c(l)c(2) • • ■ c(13)). As each color 
encoding has 2 bits, so Isj = 26. Next, we show that taking biti = 5, bit^ = 9, and 
bitz = 13 (i.e. first bits of the color encodings to the vertices 3, 5, and 7) as in the 
definition of building block satisfies the required properties. 
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Figure 2.2: Graph for the instance block^^^ 


Since the vertex 1 is always assigned color ‘11’ and there is an edge between 1 
and 2, so 2 can be colored with either ‘00’ or ‘01’, let first fix it to be ‘00’ (‘01’ 
also gives the same result). The vertex 2 is also connected with 3, 5 and 7, so these 
three vertices can be colored with either ‘11’ or ‘01’. The vertices 8, 9, and 10 are 
connected with 1, so they can be colored with either ‘00’ or ‘01’, and since they are 
also connected with 12, 11, and 13 respectively and there is a triangle on 12, 11, and 
13, so all three vertices 8, 9 and 10 can not be given the same color. The vertices 
3, 5, and 7 are also connected with 8, 9, and 10 respectively, therefore, all three 
vertices 3, 5, and 7 cannot be assigned the same color ‘01’. So if we take the first 
bits of colors assigned to 3, 5, and 7, then we will get. all three bits strings except 
‘000’ (i.e. - {000}). 

For joinability, we define bprod^^^ (x, y) = (z, a) where z is obtained as follows: 
Let X has n vertices and y has m vertices, then the vertices of y are renumbered 
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by adding n to their numbers. We add two new dummy vertices (labeling them 
n+m + 1 and n+m+2) and a triangle on vertex 1 and these dummy vertices. This 
ivill ensure that the dummy vertices are assigned color encodings { 00 , 01 }. Now, we 
idd another triangle on vertex n + 1 and these dummy vertices. This will ensure 
that the vertex n + 1 is assigned color encoding Tl’. 

The projection a is the sequence of all the bits of the solution of z except the 
ast 4 bits, which correspond to the color encodings assigned to the dummy vertices. 

Por couplability, we show that Rose is couplable in a restricted sense, however 
t is sufficient for our purpose of proving the relation to be universal. Note that, the 
ength of every solution of Rgzc is always even and the bits of projection (biti, bit2, 
md bits) of building block are odd, and when we join several building blocks to form 
m instance of Graph 3 -Coloring corresponding to any arbitrary 3 SAT instance in 
,he proof of Theorem 4.4 of [AB 92 ], then also every bit of projection is odd. Later 
n the same proof, all the coupling is done among these bits only, so if we restrict 
;he couplability to only odd bits of the solution, then that is sufficient for showing 
;he relation universal. 


Define, 




< Z,Q! > 

undefined 


where both i and j are odd numbers and i ^ j 
otherwise 


jet X has n vertices given as {vi,V2, —,Vn)- Note that and bits correspond to 
he first bits of the color encodings assigned to vertex 'yfi/2] and v^j/2-\- z and a axe 
>btained as follows: 


• If one of i and j is 1, then put an edge between Ufi/2] and ■^[^721- la this case, 
a is identity. 

• If both i and j are not equal to 1, then add a new dummy vertex n + 1, then 
add an edge between Vi and Vn+i, and then add a triangle on v^i/2]-, ^[7/21 
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and fn+i- In this case, a is all the bits of the solution except the last 2 bits 
corresponding to the color encoding of dummy vertex. 

■, it is easy to see that all required properties are satisfied. | 


: Graph /c- Coloring 

nition 2.2 Graph fc-Coloring: Given a graph G = (V, E). The problem is to 
vhether G is A:-colorable, that is, does there exist a function / : V — > {1, 2, ..., k} 
that f{u) 7 ^ f{v) whenever {u, v} € E. 

relation Rokc is: {G)RGkc{s) ilf s encodes the colors assigned to vertices of 
that the above property satisfies. Without loss of- generality, we assume that 
; colors are encoded in the binary strings of length [log k] . 

Drem 2.3 Relation RokC Is near-universal for fc > 3. 

)f: This proof is a little modification of the earlier proof for Graph 3-Coloring, 

also, we refine the relation RokC to RokC as follows; 

skCi the first vertex of the graph is always assigned the color encoded as 0 - -O 
ill bits are 0), and the next different colored vertex in the vertex ordering of 
raph is always assigned the color encoded as 0 • -01 (i.e. only LSB bit is 1). 
every color encoding has length [log A:]. For example, let V = {vi,V 2 t.—,Vn). 
ding to our assignment, vi is always assigned color encoded as 0 • -0, and let 
of vi is same as vj for 2 < j < i, and Uj+i has to be assigned different color 
;he colors of all the previous vertices in the vertex ordering, so it is assigned 
mcoded as 0 ■ -01. 

re show the solution preserving reduction from Rzsat to RokC- 


A A 
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the given formula ip of m clauses and n variables {xi,X 2 , we con- 

a graph G = (V, E) as follows: The set V consist of a vertex for each variable, 
ex for negation of each variable, five vertices for each clause and k special 
;s. The k special vertices are labeled as true, false, spi, spk- 2 - The edges 
graph are of two types: one independent of the clauses and one dependent 
clauses. The independent of the clauses edges form a complete graph on the 
I vertices and also form a complete graph on Xi, ->Xi, spi,..., spk -2 for 1 < z < n. 

Dmplete graph on special vertices enforces the assignment of different col- 
each of the special vertex and the complete graph on Xi, -^x,, spi, ..., spk-2 for 
< n enforces that exactly one of the variable and its negation is colored with 
) (c : V {1,2, ..., fc}), other is colored with c{false), and they can not be 
1 with c(spj) for all 1 < z < (A: — 2). The idea is that the variables, whose 
)onding vertices are colored with c{true), will get value 1 and the remaining 
es will get value 0 in the truth assignment of the formula ip. To enforce the 
ons corresponding to the clauses, for each clause, we have five extra vertices 
ey are connected in such a way so that at least one literal of the clause will 
ue 1 (for satisfying the clause). For example, the construction of widget cor- 
ding to the clause {x\/ y V z) is shown in figure 2.3. There, the five extra 
3 labeled as 1, 2, ..., 5 can only be assigned colors from c{true), c{false), and 
in order to meet the required conditions. 

Dr every instance ip of 3SAT, we have an instance G = (V, E) of Graph k- 
g such that for every truth assignment of ip, there is a A:-Coloringof the graph. 

utions of 3SAT instance can be obtained from the solutions of corresponding 
fe-Coloring instance as follows: 

t loss of generality, we assume that the graph is outputed as follows: initially 
il vertices {false,true,spi, ...,spk- 2 ), then n vertices corresponding to the 
Dies, then n vertices corresponding to the negation of variables, and finally 
corresponding to the m clauses, i.e. V = {false, true, spi, sp 2 , spk- 2 ,^ 1 , 
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true, sp 2 , , spjj ^_2 

Figure 2.3: The widget corresponding to a clause {xyy\/ z) 


-'Xi, -^Xn, Note that the false labeled vertex is outputed as the first 
v^ertex in the graph, so in every solution, it will be assigned the color encoded as 
} • -0 (all bits are 0), and the true labeled vertex is outputed as the second vertex in 
:he graph, so in every solution, it will be assigned the color encoded as 0 • -01 (only 
jSB bit is 1) because there is a complete graph on all special vertices. The solutions 
)f Graph fc-Coloring instance are encodings of colors assigned to every vertex and 
heir length is [log/c] *1^1. The projection sequence is just the sequence of the 
ast bits of the colors assigned to the vertices corresponding to the variables (posi- 
ive literals), i.e. a = (fc + l)* [log fc], (fc+2)* flog/i:'|, ..., (/c+n)* [logfc] and |q:1 = n. 

'herefore, the variables, whose corresponding vertices are colored with c{true), will 
3t value 1 and others will get value 0, and this assignment satisfies the formula ■0, 
hich is trivial to see from the reduction. 

s we already know that R^sat is universal, therefore, for fc > 3, ^kc is also uni- 
irsal from the above solution preserving reduction. Hence, Row is near-universal 
t k> 3. I 
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Proposition 2.1 For k > 3, relation RokC *5 universal using characterization of 
universal relations ([AB92]). 

Proof: The proof can be easily constructed in the similar way as we did for /c = 3 

in theorem 2.2. | 

2.3 A;-NM Colorability 

Definition 2.3 A:-NM colorability: Given a finite set S and a collection C = 
{ci,C2, -.,Cm} of constraints Cj C S'. The problem is to find if there is a /c-Coloring 
of the elements of S (i.e. a function ^ : 5 — »■ {1, 2, ..., k}), such that for each con- 
straint Ci G C, the elements of Ci is Not Monochromatically colored (i.e. (Vci € C) 
(3x,y e Ci) such that C(a:) ^(y))- 

The relation BkNMC is: {S,C)RkNMc{s) iff s encodes the colors assigned to ele- 
ments of S, such that the above property satisfies. Without loss of generality, we 
assume that the k colors are encoded in the binary strings of length [log k] . 

Definition 2.4 Set Splitting problem: The input is a collection C of subsets of 
finite set S and the problem is to decide whether there is a partition of S into two 
subsets Si and S 2 such that no subset in C is entirely contained in either 5i or 82 - 

Lemma 2.4 For all integers k >2, k-NM colorability is NP-complete. 

Proof: Clearly, /c-NM colorability is in NP. For > 3, there is a direct reduction 

from Graph fc-Coloring to it. Now we only need to show NP-hardness for k = 2. 
2-NM colorability is same as Set Splitting problem, which is also known to be an 
NP-complete problem ([GJ79]). | 

Theorem 2.5 Relation RkUMC is near universal for k>Z. 

Proof: Like we did in RokC, we refine this relation RkNMC to RkNMC as follows: 

I 

To the first variable of the set S, we always assign the color encoded as 0 - -0 (all 
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bits are 0), and to the second different colored variable in the variable ordering, we 
always assign color encoded as 0--01 (only LSB bit is 1). Notice that this refinement 
eliminates some redundant solutions. 

Clearly, there is a solution preserving reduction from Rokc to Runmc for fc > 3. 
Since RokC is universal, therefore, RkNMC is also universal. Hence, RkNMC is near 
universal for k>3. | 

2.4 Learning A;-term DNF Formulae 

Definition 2.5 Learning A:-term-DNF formulae: Given a set of positive and nega- 
tive examples, the problem is to output a fc-term-DNF formula, which is consistent 
with the given set of examples. 

The relation RkONF is: {S)RkDNF{'^), where ^ is a fc-term-DNF formula consis- 
tent with S. 

Definition 2.6 Learning monotone fc-term-DNF formulae: Given a set of positive 
and negative examples, the problem is to output a monotone fc-term-DNF formula, 
which is consistent with the given set of examples. 

The relation Rk-mONF is: {S)Rk-mDNF{'4>), where ip is a, monotone fc-term-DNF 
formula consistent with S. 

Lemma 2.6 For k>2, Learning k-term-DNF formulae is NP-Complete. 

Proof: Learning fc-term-DNF formulae is clearly in NP. For NP-hardness, we can 

reduce fc-NM colorability to the learning problem of fc-term-DNF formulae ([PV88]). 
Therefore, it is NP-complete. | 

Corollary 2.7 Fork > 2, Learning monotone k-term-DNF formulae is NP-complete. 
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Proof: Clearly, learning monotone A:-term-DNF formulae is in NP. For NP- 

lardness, we can reduce learning problem of A:-term-DNF formulae to it ([KV94]). 
Therefore, it is NP-complete. | 


'Jext, we will show that RkONF is near universal for k > Z. For that, we need 
I different solution representation in Rokc- First, we prove that different defini- 
ion of RckC is also near-universal. After that, we will similarly define different 
olution representation in RkNMC and prove it to be near-universal, and then we 
7ill prove Rk-mONF to be near-universal. In the end, we will show that RkONF is 
ear-universal for fc > 3. 

Ve modify the solution representation of Graph' A:-Coloring as follows. In the so- 
ition string, every color is encoded as k bits string, where bit is 0 implies that 
olor i can be assigned. Notice that, now an encoded color can represent more than 
ne possible color assignment to the corresponding variable. 

lemma 2.8 The modified relation RokC is near-universal for k> 3. 

'roof: First we refine this modified relation Rokc to modified RckC to eliminate 

)me redundant solutions as follows: first vertex of the graph is always assigned 
)lor encoded as 01 • -1 (only MSB bit is 0). Note that, now every solution string 
arts with 0 in its MSB position. 

ow, we can show solution preserving reduction from Rzsat to modified RokC- 
he whole proof is same as proved earlier for the different solution representation, 
herefore, modified RckC is near-universal. | 


ext, we modify the solution representation of A;-NM Colorability as follows. In 
e solution string, every color is encoded as k bits string, where bit is 0 implies 
at color i can be assigned. 

emma 2.9 The modified relation RkNMC is near-universal for k > 8. 
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Proof: First we refine this modified relation RkNMC to modified RkNMC 2ts fol- 

lows: first variable is always assigned color encoded as 01 • -1 (only MSB bit is 0). 
Therefore, now every solution string starts with 0. 

Clearly, there is a solution preserving reduction from modified Rokc to modified 
RkNMC- Therefore, modified Rh-nmc is universal and modified RkNMC is near- 
universal. I 

Theorem 2.10 Relation Rk-mDNF i$ near-universal for k>3. 

Proof: The solution string in Rk-mUNF is represented by nk bits, where n is 

the number of variables in the input examples. In the solution string, every n bits 
represent one term of the output formula. Let there are n variables in the input 
examples ( 2 : 1 , X 2 , ..., 2 :„), then if Xi is present in a term, then the bit in that term 
will be 1, otherwise 0. 

First we refine this relation Rk- 7 nDNF to Rk-mDNF as follows: if the solution con- 
tains a term which does not has Xi, then that term is outputed as the first term in 
the solution string. 

FVom the reduction of fc-NM colorability to learning problem of monotone A:-term- 
DNF formulae ([PV88]), it is easy to see that there is a direct solution preserv- 
ing reduction from modified RkNMC to Rk-mDNF, where projection sequence a is 
l,n + l, 2n-|-l, ..., (fc — l)n-i-l,2,n-t-2, ..., {k— l)n-t-2, ...,n,2n, ...,kn and ja] = nk. 
Therefore, Rk-mDNF is universal and Rk-mDNF is near-universal. | 

Theorem 2.11 Relation RkDNF is near-universal for k >Z. 

Proof: The solution string in RkDNF is represented by Znk bits, where n is the 

lumber of variables in the input examples. In the solution string, every 3n bits 
■epresent one term of the output formula. First 2n bits in a term, represent cor- 
•esponding 2n literals, let say in the order {xi,-‘Xi,X 2 ,-<X 2 ,—,Xn,-‘Xn), so if Xi is 
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present in a term, then (2 * (i — 1) + bit of that term will be 1, otherwise 0. The 
last n bits in a term contain information on the previous 2n bits of the same term 
as follows: 

for i = 1 to n 

if ((rcj V ->Xi V V -iXj+i... V ->x„) is 0) 

then bit of last n bits is 0, otherwise 1. 

Next, we refine this relation Ruonf to RkUNF as follows: if the solution contains a 
term, where (2n + bit is 0 in the solution string of that term, then that term is 
outputed as the first term in the solution string. . 

Now, it is easy to see the solution preserving reduction from modified RkNMC to 
RkDNFi where projection bits are last n bits of each term in the following order, i.e. 
a = 2n + 1, 5n + 1, ..., 2>nk — n + 1, 2n + 2, 5n + 2, ..., Znk — n + 2, ..., 3n, fin, ..., Znk 
and |a| = nk. Therefore, RkDNF is universal and Rk-ONF is near-universal. | 


2,5 Generic NP-complete Language 

Definition 2.7 Generic Complete Language for MV: 

Lamp = 1”)| NDTM M accepts x in at most n steps} 

The relation Rhccmp is: {LI,x, V^)RLcomp''^ iff tw is an accepting configuration of M 
on input x and w has at most n configurations. 

Theorem 2.12 Relation Ri^^^p is universal. 

Proof: We prove the universality of RL-^mp by showing that Rxcomp is joinable, 

couplable and has a building block. The construction of this proof is similar to the 
proof of universality for the relation witnessing k-creative sets ([JY85]) in [AB92]. 
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Let y = {yuy 2 , ym), where each yi is {Mi, Xi, 1^). Define (y) = {z, a), 

where 2 : = (M, xiifx 2 # ■ ■ ■ i^Xm, and NDTM M on input a;i#a: 2 # • ■ • #Xm 

guesses the string s = wi#W 2 # • • • #«'m and accepts iff for every j less than or equal 
to m, {Mj,Xj, 1”^) Rhcomp By suitably choosing p(.), we can ensure that running 
time of M is enough to simulate all the M-s for 1 < z < m. We assume that the 
guess string is written in some fixed bit positions in the accepting computation of 
M, so we can easily compute a. 

Define cpIrj^^^^^{{M,x, V^),{i\,...,im)y{ji,-,3m)) = {z,P), where 2 : is (Mi, a;, 
and NDTM Mi on input x guesses the string s = w and accepts if (M, x, 1”) Ricomp 
w and for all r less than or equal to m, and bit of w is different. By suitably 
choosing q{.), we can ensure that running time of Mi is enough to simulate M. Here 
P is identity. 

The instance blockR^^^^^ = (M, x, 1"), where NDTM M on input x guesses a string 
of length three and accepts in at most n steps iff guessed string is not ‘000’. | 


2.6 Conclusion 

In this chapter, we have proved some NP-complete problems to be universal - some 
through properties of their corresponding relations (i.e. join, couple and block) and 
some through solution preserving reductions from known universal relations. The 
major goal of the theory of universality is to obtain the proof of NP-completeness 
through the properties of the relation instead of searching for some suitable known 
NP-complete problem for the reduction. We have succeeded in getting some results 
through these properties in the relations, however for others, the standard relations 
do not seem to possess all the properties. 

We have showed RkNMC and Rhonf to be near-universal for k > Z. For k = 2, 
we could not get the proof because we were trying to prove the universality of 
R 2 NMC through solution preserving reduction from standard witnessing relation for 

irwrfer »« J 
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NAE1-3SAT (Not All Equal 3SAT ([GJ79|)), but standard relation witnessing NAE- 
3SAT does not seem to be universal. 

The defined relation RkNMC is not a natural one, we have put additional infor- 
mation in its solution string in order to prove it near-universal through solution 
preserving redcution from RkNMC- The standard relation witnessing RkNMC does 
not seem to be universal. 

For further work in this direction, it would be interesting to get the results of uni- 
versality for RkNMC and RkONF through characterization of universal relations. 
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Chapter 3 


1-NL Universality 


[n this chapter, we extend the notion of universality to the complexity class 1-NL. 
The basic ideas are similar to NL universality ([CSB04]), however it is interest- 
ing to apply those ideas here because of the idiosyncrasy of this class due to its 
Dne-way read-only input tape. As we stated in the introduction, this class is im- 
Dortant because although 1-NL is computationally very weak compared to NL, yet 
my complete set for it under 1-L reductions is also complete for NL under L reduc- 
ions. Therefore, if a 1-NL complete set can be shown in L, then the space bounded 
ieterministic and non-deterministic computations for space 0(log n) collapses (i.e. 
L=NL). 

5.1 1-NL Relations 

Basic concepts of relations, their associated languages, and solutions can be read 
rom [CSB04]. 

Definition 3.1 A relation J? is a 1-NL relation if it satifies the following conditions: 

1. There is a fixed polynomial p(.) such that whenever x is in Lr, sol-lenR{x) = 

pd^D- 

2. There is a deterministic logspace machine Mr with two one-way read-only 
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input tapes, such that, for all (x, y), with x is on one tape and y is on another 
tape, Mr accepts iff (x, y) € R. 

I^roposition 3.1 A language L is in 1-NL iff there is a 1-NL relation R such that 
'^ = Lr. 

^roof: (=>) Let L is accepted by a 1-NL machine M. The working of M can be 

ummarized as follows: it reads some bits of the input x from the one-way read-only 
aput tape, and then guesses some bits, and then does some computation on the 
rark-tape. It repeats this process and finally accepts or rejects. Let y = yiy 2 • • • ym, 
/here yuy 2 -, —lym are the bit strings in the same order as they are guessed by M 
i.e. yi is guessed before yi^i for all 1 < i < m —.1). We assume that length of all 
■s are same and fixed. If M accepts x in the above process, then we call y to be 
lie witness for x E L. Now, we define a relation R which contains all such pairs 
E,y), for which y is the witness for x £ L. Clearly, the length of y is bounded by 
(jx|), where p(.) is a polynomial and given (x,y), with x on one one-way read-only 
iput tape, and y on another one-way read-only input tape, a deterministic logspace 
lachine Mr can simulate M on input x, such that all the guess bits of M are al- 
jady given as y, and it accepts iff M accepts x with the guess bits y. Therefore, 
le relation Ris a, 1-NL relation such that L = Lr. 

^=) Let i? is a 1-NL relation and Mr is a deterministic logspace machine with two 
ae-way read-only input tapes (one for x and one for y), which accepts (x, y) € R. 
ow, define a languages L, which contains all the x's such that 3(x, y) € R. We now 
low that L can be accepted by a 1-NL machine M. The machine M on input x 
mulates Mr, and whenever Mr needs to read bits from the input tape containing y, 
guesses those bits, and accepts iff Mr accepts (x, y), here y are the concatenation 
: all the guess bits by M. Clearly, M accepts L and L = Lr. | 
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3.2 Blocks, block-masks, and projections through 
masking 

These definitions for blocks, block-masks and projections throught masking are taken 
from [CSB04]. We assume that if i? is a 1-NL relation, then every solution of length 
n is the concatenation of a number of equal length blocks. Length of a block in a 
solution of instance x is 0{log\x\). If a; € Lr, then block-len{x) specifies the length 
of each block in solutions of x, and further, block-len{.) is 1-L computable. (Clearly, 
sol-len{x) is an integral multiple of block-len{x)). 

The role of block-mask is to filter out certain bits from a block. Let I be the 
length of each block for some instance x. Then the block-mask is also a string of 
length I over {r, d, mo, mi}. The bit of the block-mask specifies what is to be 
done with the bit of a block: r for retaining that bit, d for dropping that bit, mo 
for matching the bit with 0, and mi for matching the bit for 1. When a block-mask 
is applied on a block, the bits of a block are retained or dropped as specified in the 
mask provided bits those are to be matched as specified by mo and mi in the mask 
are indeed matched the block. If the matching is not successful, then the result of 
applying the mask on the block is an empty sequence. Matched bits, if any, are not 
retained on masking. 

Definition 3.2 (Projection through masking) Let 5 be a set of solutions where 
the block length is I, and each solution be of m blocks. Let o; be a block-mask. Then 
the projection of S through a, denoted by proja{S) is defined as the set 
{Q:(6i)a(62) • • • a:(6m)i Each bi is a block, and 6162 •• - bm & S} 

Definition 3.3 (Admissible block-masks) A block-mask a is said to be admis- 
sible for a set S of solutions if 

1. The length of a is same as that of a block in the solutions. 

2. a has at least one r symbol, and 
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3. If match symbols mo or mi occur in a, then in every solution in S there will 
exist at least one block where matching will occur on every match symbol in 

a. 


Proposition 3.2 For any relation R, a string x, and a block-mask a, such that a 
is admissible for solii(x), then proja{solR{x)) is non-empty iff x £ Lr. 


3.3 Universality 

Definition 3.4 /; E* — + E* is said to be a solution preserving reduction from a 
1-NL relation Q to a. 1-NL relation R if 

1. / is computable in 1-L, and 

2. For all x € E*, there exist some string z and a block-mask a admissible for 
soIr{z) such that f{x) = {z,a) satisfying proja(solR{z)) = soIq{x). 

We assume that the paring function used in above definition is such that its inverse 
is computable in 1-L. 

Proposition 3.3 If f is a solution preserving reduction from a 1-NL relation Q to 
a 1-NL relation R, then Lq Lr via an f\ which is an inverse pairing function 
off 

Definition 3.5 A 1-NL relation R is 1-NL universal if for every 1-NL relation Q, 
there is a solution preserving reduction of Q to R. 

Proposition 3.4 If R is 1-NL universal, then Lr is 1-NL-complete. 

Definition 3.6 A directed acyclic graph G is said to be listed in topologically sorted 
order if for any pair of edges (a, b) and {b, c) in G, edge (a, 6) is listed before (6, c) 
([HIM78]). 

TAGAP = {{G,s,t) I G is a directed acyclic graph given in topologically sorted 
order, s and t are two distinguished vertices, and there is a path from s to t in G }. 


26 



Proposition 3.5 TAGAP is 1-NL complete under one-way log-tape reductions as 
well as NL-complete under two-way log-tape reductions ([HM81]). 

We assume that vertices in the graph are labeled as numbers from 1 to n, when 
there are n vertices in the graph. A directed acyclic graph G can be represented 
by labeling the vertices in such a way so that all the edges are from lower to higher 
labeled vertices. We say G is in lexicographically sorted order, if consecutive edges 
in G satisfy following; 

if (a, b) and (c, d) are consecutive edges in G, then either c > a or (c = a and 
d > b). 

We say that the representation of a directed acyclic graph G is in restricted topo- 
logically sorted order if all the edges in G are from lower to higher labeled vertices 
and they are listed in lexicographically sorted order. 

Definition 3.7 RTAGAP = { {G,s,t) | G is a directed acyclic graph given in 
restricted topologically sorted order, s and t are two distinguished vertices, and 
there is a path from s to t in G}. 

Proposition 3.6 By a logspace transducer, we can obtain an instance y of RTA- 
GAP from an instance x of TAGAP such that y G RTAGAP iff x G TAGAP. 

Proof: Let x has n vertices. From x, we obtain a graph G = (V, E) such that 

V — (1,2,...,ti), and the edges in G are obtained from edges of a: as follows: Each 
edge has two vertices, starting vertex and ending vertex. We go through the edges 
of X from left to right and relabel the starting vertex of each edge as follows: If this 
vertex has already been relabeled by some number before, then relabel it with the 
same number, otherwise relabel it with the least number starting with 1, that has 
not been assigned to any vertex till now. Next we repeat the same process for the 
ending vertices. Since x is in topologically sorted order, so G will also satisfy this 
property after relabeling and note that, now all the edges in G are from lower labeled 
vertex to higher labeled vertex. Thus only sorting of these edges is remaining to get 
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the desired instance y from G. 


Note that all these operations can be carried out by an L transducer and the graph 
y is same as x, only we have relabeled the vertices, therefore x e TAGAP iff y € 
RTAGAP. I 

Without loss of generality, we assume that s and t are 1 and n respectively. (If 
they are not, then using a 1-L transducer, we can get another restricted topologi- 
cally sorted graph G' from G such that G has a path from s to t iff G' has a path 
from 1 to n.) 

Let Rrtagap is the 1-NL relation for RTAGAP, and it is defined as: ((G, 1, n), y) € 
Rrtagap iff y = V1V2 •••Vn where G has n vertices, Uj’s are vertex labels ({l,2,...,n}) 
of G, Wi is 1 and there is some k such that for ally, 1 < j < k, {vj, Uj+i) is an edge of 
G and Vj+i > Vj (Note that all vertices are labeled with numbers), and Vk = Vk+i = 
... = Vn = n. In other words, y gives the labels of some 1-n path in G with the end 
padded with repetitions of the vertex label n so that y has exactly n vertex labels. 
We need this padding to make every solution of (G, l,n) to have the same length. 

Proposition 3.7 RTAGAP is l-NL-complete under one-way log-tape reductions as 
well as NL-complete under two-way log-tape reductions. 

Proof: From the definition, it is clear that RTAGAP is l-NL-complete under 

one-way log-tape reductions (proof is slight modification of theorem 2 of [HM81]). 
Since TAGAP is NL-complete under two-way log-tape reductions and an instance of 
TAGAP can be easily transformed into an instance of RTAGAP by a logspace trans- 
ducer. Therefore, RTAGAP is also NL-complete under two-way log-tape reductions. 


Theorem 3.1 Relation Rrtagap ^ 1-NL universal. 

Proof: We prove this by showing solution preserving reduction from every 1-NL 

relation Q to Rrtagap- 
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Let Q be a 1-NL relation and M be a 1-NL machine such that L{M) = Lq. Now 
first see how M works. On input x, M guesses bit by bit the solution y, such that 
{x,y) G Q iS X e Lq. 

Let whenever M guesses a bit, it appears on the configuration in the end. Therefore, 
from each configuration, there are two moves representing guessed bit 0 and 1. Let 
L be the length of configuration of M on input x. (Note that given x, L is 1-L 
computable.) Let STARTj; is the starting configuration of M on a: and ACCEPT is 
the unique accepting configuration, so if a: 6 L, then M goes to ACCEPT. These 
different types of configurations can easily be checked by projection through mask- 
ing (more details are given in [CSB04]). 

Consider a 1-L transducer T. It first outputs all the configurations of M on x 
as the label of vertices of the graph Gx and then it enumerates all the configurations 
in lexicographically sorted order, and for each such configuration Ci, it again enu- 
merates all the configurations in lexicographically sorted order such that for each 
such configuration C 2 , if Af can move from Ci to C 2 in one step, then it outputs the 
pair (ci, C 2 ) on the output tape representing an edge of Gx- After outputing all such 
pairs, it outputs STARTj, and ACCEPT. (Note that this transducer is almost same 
as the transducer in the proof of theorem 2 of [HM81].) 

Next, T outputs block-mask a, of lenght lx, is such that it retains the last bit 
of a block (which is in fact the guessed bit used to arrive at the configuration that 
corresponds to this block from the previous configuration. Note that block length 
of {Gx, STARTx, ACCEPT) is Q- 

It is clear from the above that M accepts x using y as a solution iff there is a 
path from START^, to ACCEPT in Gx, and y is the concatenation of the bits cho- 
sen by a. Therefore, T is a solution preserving reduction from Q to Rrtagap- 
Hence, Rrtagap is 1-NL universal. I 


29 



3.4 Characterization of 1-NL Universality 


Definition 3.8 (build operation) A 1 -NL relation R is said to have the build 
operation if there is a 1-L computable function buildn : 1* — > E* such that for all 
positive integers n, there exist a string x over the alphabet of E, and a block mask 
a, this block-mask is admissible for soIr(x), such that blockR{V^) = {x, a) satisfying 
the following; 

n— 2 

U U Li ‘ ^cr(pi) ' * ^crijPk) * ^ ^ 

/c=l P,|P|=:A:,PC{2,...,n-l} creSk 

In the above, Sk denotes all the permutations in increasing order of k elements 
(i.e. for all i, < Sk[i + 1 ]), Pi denotes the element of P (P being a set 
of k integers), Ci denotes the binary encoding of positive integer i, and finally, in 
the argument string, at the end there will be exactly as many c„’s so that the 
total number of Ci’s in the argument becomes exactly n. (Here • denotes the string 
concatenation operation.) 

Definition 3.9 (prune operation) A 1-NL relation R is said to have the prune 
operation if there is a 1-L computable function pruntR : E* S* such that for all 
n, and for every lexicographically sorted set of pairs {(wi,t;i), {u2,V2)^ — , {uk,Vk)}, 
all Ui,ViS being equal length strings, there exist 2 and an admissible block-mask /? 
such that 

pruneR{{buildR{l'^), {{ui,vi), {u2,V2), {'^k,Vk)})) = {z,^) 

with z and /3 satisfying 

pToj^{solR{z)) = {w \ w £ projaisolR{x)), where x = wi o buildR{V^) and a = 
tz2 o 6uiZdH(l"'), TTi and 112 are inverse pairing functions, with the property that if 
w is the blocked projection (with a) of the solution y of tti o build r{ 1 ^), assuming 
y = 6162 ■■•br, each k being a block of y, then there exist no y, 1 < j < r, such that 
■for some i, 1 < i < k, uiVi is being equal to a{bj)o'{bj+i)} 
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Note that we can replace the first parameter by 1” in pruneR function 

when the definition is clear. 

Proposition 3.8 Rrxagap has build and prune operations. 

Proof: For all n, buildRj^.j.^^^p{l^) outputs {G, 1, n), where G is a directed acyclic 

graph of n vertices labeled from 1 to n, such that all possible edges from lower 
to higher labeled vertices are present in G in lexicographically sorted order (i.e. 
E{G) — {(1, 2), (1, 3), (n — l,n)}). This function is clearly 1-L computable and 
the solutions of this instance (G, 1, n) satisfy the definition of build operation. 

For prune operation, suppose we want to compute 

pruneRj^^^j^p{{huildR{V^),{{ui,Vi),{u 2 ,V 2 ),...,{uk,Vk)})). Note that the set S = 
{(wi,ui), (u 2 ,‘y 2 )) •••) (wfc,Ufc)} is lexicographically sorted.- This function will output 
(G', l,n) such that G’ has n vertices and edges in G' are E{t!i o huildR{V^)) — S 
(here E{G) denotes the edges of graph G). Since E{'Ki o buildR{l'^)) — 5 is in lex- 
icographically sorted order, so P^'^'n-e.RKrAGAP computable by a 1-L transducer. 
I 

Theorem 3.2 A 1-NL relation R is universal iff it has build and prune operations. 

Proof: (<=) : To show this part, we prove that there is a solution preserving 

reduction from Rrtagap fo R- 

Given an instance of Rrtagap, say (G,l,n), we can construct an instance of R 
such that the solution space is same for both. The corresponding instance of R is 
prune R{build r{1'^), S), where S is the set £'(7ri o build Rp^j^^j^p) — E{G). Since G 
is in restricted topologically sorted order, so we can easily compute S' by a 1-L 
transducer Ti. Therefore, the composition^ of Ti followed by the 1-L transducer 
computing pruncR gives the solution preserving reduction from Rrtagap to R. 


^we require 1-L transducers to be closed under composition, [A1188] describes two definitions of 
1-L transducers where one is closed and another is not. 


31 



(=^) : For the other way, since R is universal, so there are solution preserving 
reductions / from Rrtagap to R as well as g from R to Rrtagap- 

buildn can simply be defined as: 

Let ) {^Z\, and ~ so (5'). 

gTuneR{huildR{V'),S) can be obtained using as follows: 

Let (1 ),5) is (zi,q;^. Now let f{zij = (^Z 2 ,P'}- There- 

fore, pruneR{buildR{V^), S) is (^ 2 , 0 : • /?)• (Note that we do not need g in proving 
this direction.) | 

3.5 Conclusion 

In this chapter, we have shown 1-NL universality. The 1-NL set RTAGAP is shown 
to be 1-NL univemal. RTAGAP is a variant of TAGAP (a natural 1-NL-complete 
problem) and we have shown a reduction from TAGAP to RTAGAP through L trans- 
ducer. We could not show that TAGAP is 1-NL universal, so it would be interesting 
to get either the reduction from TAGAP to RTAGAP through 1-L transducer or a 
different universality notion for 1-NL so that TAGAP can be shown 1-NL universal. 
We require 1-L transducers to be closed under composition for the characterization 
of 1-NL universal relations. 
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Chapter 4 


PCP Universality 


As we stated in the introduction, PCP gives a different account for the class NP 
and it defines a very different natural NP-relation. The, notion of universality was 
introduced for the classical NP-relations, so the motivation of this study is to apply 
the same technique to the new form of NP-relations as per PCP. In this chapter, we 
go through the sketch of the PCP theorem and thoroughly analyze the proof string, 
which will later help us in proving the universality of the relation witnessing 3-SAT 
as per PCP by showing solution preserving reduction from the standard relation 
witnessing 3-SAT to it. 

4.1 PCP Theorem 

The basic definitions of the PCP class and other preliminaries can be read from 
[Aro94, RS95, DKOO]. In this section, we sketch of the proof of the PCP theorem 
with the intention of thoroughly understanding the structure and content of the 
proof string. The proof of the PCP theorem is divided into four parts and we will 
go through each part separately. 

Theorem 4.1 [PCP Theorem] ^fV = PCP (log n, 1) 

Proposition 4.1 PCP(logn, 1) C MV 


33 



4.1.1 MV C PCP(logn,;?o^2/logn) 

The verifier V of PCP (log n,pc>i^ log n) machine has to verify that for the input 
X, 3y such that is satisfiable, where \y\ = p(|a:|) for some polynomial p(.). 

The prover provides the assignment (x, y) in the form of a table A of low degree 
extension of the assignment function A {A: [h]”* (encoding of variables) — > {0,1})- 
Now, the verifier’s task is to verify that A is indeed a low degree extension of some 
assignment function A which is a satisfying assignment for (p{x,y), and finally the 
assignment for x provided by the prover is consistent with the input x. First the 
verifier performs low degree test on the table A. If the test is successful, then it 
constructs the weighted arithmetization of the 3 -SAT formula (p{x,y) and uses the 
following protocol to verify with high probability that the assignment provided by 
the table A is indeed a satisfying assignment to ip{x,y). The weighted arithmetiza- 
tion is obtained using random bits (for details, see (AS92, RS95]). 

Protocol: 

The weighted arithmetization can be finally restated as: 

^ Q(wi,W2,-,W^4m) = 0 

<tt;i ,IU2 V • 

For 1 < i < 4m and oi, 02 , - , ocim € T is the large field containing h), let 

Ei{x) = X) Q{ai,a2,..-,(Xi-i,x,Wi+i,...,Wi.m) 

1 . Set /3 = 0 . 

2 . For i = 1 to 4m 

- Read Ei{x) from the proof string. 

- If EcceM ^ reject. 

- Choose Oi € JF at fandom, and set P = Ei{ai). 

3. Evaluate p' = Qioci, 02 , CK 4 m), if P' 7 ^ P, then REJECT. 

4. Choose cc € at random, and if Aq (o) 7 ^ A^(o:), then REJECT. 
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5. ACCEPT. 


In the above protocol, Aq is the low degree extension of the input assignment func- 
tion, which the verifier can construct itself from the input x, and is the low 
degree extension of the input assignment function provided by the prover. 

For the entire protocol to work correctly, for every possible random sequence r, 
which the verifier is using to construct the arithmetization of the 3-SAT formula 
(p{x,y), the prover provides coefficients of low degree extensions Ei{x) of all the 
polynomials Ei{x) which the verifier can possibly asks. 

The structure of proof string given by the prover is as follows: 

Table for A (low degree extension of the assignment function A) 

+ 

For every possible r (random sequence used to construct the weighted axithmetiza- 
tion of ip{x, y)), coefficients of low degree extensions Ei{x) of the polynomials Ei{x) 
for all i (Since Ei{x) depends on the random numbers picked by the verifier during 
the above protocol, so for all combinations of ai, 0 : 2 , — , ctf-i € E, the proof string 
contains the coefficients of low degree extensions of all such possible Ei{x)) 

+ 

Coefficients of the polynomials for the low degree tests 

The bits corresponding to the assignment (x, y) can be obtained directly from this 
proof string as follows. The assignment function A assigns value {0,1} to all the 
variables. Therefore, all the assignment bits can be obtained from the table for A. 
Instead of table for A, we have been given the table for A, which is the low degree 
extension of A. The table for low degree extension / of any function / contains all 
the bits of the table for /. Therefore, all the bits of A are also present in A. Note 
that the assignment bits positions are also fixed once the structure of this proof 
string is fixed. 
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4.1.2 Input is Encoded 


In the protocol above, the verifier reads the input only to verify that the part of 
assignment provided by the prover is consistent with the input bits. The verifier 
checks this by first constructing low degree extension of the input, and then verify 
it with the prover’s assignment of the input bits {Aq) at some constant number 
of random points. In construction of the low degree extension of the input, the 
verifier reads all the bits of the input. However, if the input is provided as a table 
of low degree extension of the input bits, then the total number of bits read from 
this table is bounded by poly log n. In this case, the verifier also has to perform low 
degree test on the table in order to check that it indeed corresponds to some input. 
In low degree test, the number of bits required from the table are also bounded 
by poly log n, hence the total number of bits read from the table is bounded by 
poly log n instead of n bits in the original protocol. 

4.1.3 Reducing the Number of Probes 

In the proof of J\fV C PCP(logn, poly log n), the verifier is using O(logn) random 
bits and reading poly log n bits from the proof string, which are located in different 
parts of the proof. Next, we reduce the number of probes so that we read these 
poly log n bits from constant number of locations in the proof string. We can think 
of the proof string as a function tt, which takes address of the location in the above 
proof string and outputs the bit {0,1} stored at that location (tt: P (encoding of 
address) {0,1}). The prover provides the table of the low degree extension # of 
TT instead of the above proof string. In addition of the table for tt , the prover also 
provides coefficients of the polynomials Fao.r for every ao E Q'^ (Q is the large field 
containing I) and r (O(logn) random bits used by the verifier). Details of Tao,r is 
given in lecture 9 of [RS95]. Note that once the random bit string r is fixed, then all 
the probing locations in the proof string are also fixed. Now the verifier randomly 
picks r and uq and obtains the coefficients of the polynomial Fao,r from the proof 
string and runs the previous protocol such that whenever it needs 7r((Zi), it uses 
Pao,r(0 instead. 
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After reducing the number of probes, the structure of the proof string is as fol- 
lows: 

Table for tt 

+ 

For all values of r and co E coefficients of the polynomials Fo^^r 

+ 

Coefficients of the polynomials for the low degree tests 

Prom the above proof string, the assignment {x, y) can be easily obtained and their 
positions can also be fixed. Since there are fixed positions of all the assignment 
bits {x, y) in the earlier proof string and the new proof string contains all the bits 
of earlier proof string in the table of #, so we can easily map the locations in the 
earlier proof string to the locations in the new proof string. 

4.1.4 MV C PCP(logn, polyloglogn) 

The verifier of the PC P {log n, poly log n) machine works as follows. It gets a random 
string f of O(logTi) and then based on input and f, it obtains the query locations 
d in the proof string. For the consistency checking of the input bits with the as- 
signment provided by the prover, it obtains a bit string b, which are the bits in low 
degree extension of the input at some random points. Finally based on f and input, 
it queries the proof string at some constant number of locations to read constant 
number of cells. Let these cells are ci, 62, ..., Ct- After this, the verifier checks 
that the string z = (f, a, b, ci, ..., Ct), of length polylogn, satisfies a polynomial time 
predicate (or belongs to the language L eV). 

Using Cook-Levin’s theorem, we can obtain a 3 -SAT formula (pr which is satisfi- 
able iff the input string z, which depends on the random string f, belongs to L. For 
the satisfiability of (/?r, we can again use the same protocol. For this, the prover pro- 
vides additional proof strings for the satisfiability proof of Pr for every f. Note that 
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in the recursive step, the input z is not completely known to the verifier in advance, 
and we do not want it to read all the bits from the proof string because its length 
is polyXogn. As we have already seen how we can check membership proof of the 
input without reading all the bits of the input using table of low degree extension 
of the input, so the part of the input bits (all Cj’s), which are to be read from the 
proof string, are provided by the prover as low degree extensions, and the verifier 
constructs itself low degree extensions of the remaining part of the input. Therefore, 
the bits read from the proof string are only poly log log n and the random bits used 
are still O(logn). 

The structure of the proof string is as follows: 

Tables of low degree extensions of every cell (size log |Q|) of table tt 

+ 

Tables of low degree extensions of each Fao,r (size kd\I\ log \ Q\) 

+ 

For all values of f, proof string for (fr 

+ 

Coefficients of the polynomials for low degree tests 

Prom the above proof string, the assignment {x, y) can be easily obtained and their 
positions can also be fixed. Since there are fixed positions of all the assignment bits 
(a;, y) in the earlier proof string and the new proof string contains all the bits of 
earlier proof string in the tables of low degree extension of the cells of tt and Fao,ri 
so we can easily map the locations in the earlier proof string to the locations in the 
new proof string. 

4 . 1.5 J^V C PCP{poly,l) 

This protocol, which we describe next, uses many random bits {0(n^)), however 
number of query bits are bounded by some constant (0(1)). Here also the prover 
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tries to convince the verifier that ip{x, y) is satisfiable. Let a is the assignment en- 
coded in the proof string provided by the prover. The verifier has to check that 
a is the satisfying assignment for y){x,y), which it does as follows: It arithmetizes 
each clause Cj of (p{x,y) and obtains a polynomial Cj{x,y). For example, if Cj is 
(xi V ->X2 V yz), then Cj(x, y) = {1 — a:i)x2(l — yz). Thus Cj{a) is true iff Cj(a) = 0 . 
Therefore, the verifier has to check that V j, Cj(a) = 0. Note that we are working 
with field of size 2 in this protocol. 

The verifier uses n random bits (let n is the number of clauses in (p{x,y)) and 
obtains a weighted sum of the above condition: 

Y^rjCjia) = 0 
j 

Proposition 4.2 IfSj Cj(a) ^ 0 , then Prr\^rjCj{a) 0] = 1 /2. 

j 

The weighted sum can be expressed as: 

'y j Cj (Q-) ~ C “h ^ ^ OjQi "t" 'y ^ PijO'iOij 'y ^ 'Jijk^i^^j^k (I) 

j i <hj> <i,j,k> 

where 

• ^ is a constant term (either 0 or 1) 

• i, j, k are ranging from 1 to n 

• o, /3, 7 are {0,1} vectors of size n, n^, n® respectively. 

The prover provides the assignment a in terms of tables Ti, T2, and T3 defined as: 

n 

1. Ti : {0,1}” -> {0,1} defined by Ti(q:) = 

i=l 

2. T 2 : {0,1}”' {0,1} defined by T 2 {P) = E AjOiOj; 

ij=l 

n 

3. Tz : {0,1}”' -> {0,1} defined by Tzij) = E IvkOidjak- 

i,j,k=l 
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Hence checking of weighted sum requires only 3 bits from the proof string. The 
verifier also has to perform linearity and consistency testing of these tables, which 
requires O(n^) random bits and 0 ( 1 ) query bits. Therefore, total number of random 
bits used are O(n^) and query bits are 0 ( 1 ) in the above protocol. 

The proof string consists of tables Ti, Tj, T3 of sizes 2 ", 2 "', 2 "" bits respectively. 
The assignment a can be easily obtained from the table Ti and its positions are also 
fixed. 

4.1.6 jVP C PCP(logn,l) 

The verifier for PC'P(log n, 1 ) composes two verifiers Vi in POP(log n, poly log log n) 
and V2 in PCP{poly^ 1). It first uses Vi to get the string z = (r', a ,b ,0^,02, •••, c^) of 
length poly log log n, which now has to be checked for a polynomial time predicate or 
membership to the language L G P. Getting this string z requires O(logn) random 
bits. The membership proof of z is now checked by V2, which uses 0 (|zp) random 
bits and queries constant number of bits from the proof string. Therefore, total 
number of random bits used by the verifier V3 is O(logn) and query bits are 0(1) 
only. 

Note that V3 also has to check the consistency of the input string z with the in 
put assignment provided by the prover. For this, all c^s (cells of the proof string 
of the verifier V^i) are provided by the prover as tables of size 2' bits in the proof 
string. These tables represent the linear functions defined by the cell entries. 

The structure of the proof string is as follows; 

Tables Ti, T2, T3 for all possible input strings z 

+ 

For each cell in the proof string of Vi, table representing the linear function of the 
cell entries 
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Since a has fixed positions in the proof string of Vi, so it can be easily obtained 
from the tables representing the linear functions of the cell entries in the proof 
string of Vi- Therefore, we can easily fixed a positions in the proof string of V 3 . 

Hence MV = PCP(logn, 1). 


4.2 PCP Universality 

We prove that the relation witnessing 3-SAT defined as per PCP is universal by 
showing solution preserving reduction from the natural witnessing relation of 3-SAT. 

Definition 4.1 The relation Rzsat(,pcp) is; (^) Rzsat{pcp) (H) iff 11 is the proof 
string that causes the verifier V of PC'P(logn, 1) machine M to accept for every 
random string (i.e. with probability 1). 

Proposition 4.3 Rzsat(^pcp) an NP-relation. 

Proof: In PC'P(logn, 1) machine, the verifier V uses O(logn) random bits, 

hence total number of possible random strings are bounded by some polynomial. 
Therefore, an NP-machine M can simulate all the random bits and verify that V 
accepts the proof string 11 for all the random bits. Every simulation takes only 
polynomial amount of time and there are polynomial number of iterations, so total 
time is bounded by some polynomial in the size of the input. | 

Proposition 4.4 Relation Rzsat{pcp) *5 universal. 

Proof: As we have already seen in the proof of the PCP theorem that assignment 

bits d encoded in the proof string 11 can be easily fixed, hence there is a solution 
preserving reduction from Rzsat to Rssat{pcp)- Therefore, relation Rzsat{pcp) is 
universal. | 



4.3 Conclusion 


We have proved that the relation witnessing 3-SAT as per PCP is universal by 
showing the solution preserving reduction from the natural relation witnessing 3- 
SAT. Our goal was to prove it universal by showing it joinable, couplable and having 
a building block. The instance building block in Rzsat(^pcp) is straightforward and 
restricted couplability can also be shown, but it does not seem to have the join 
property directly. Therefore, with the current proof string as defined in this chapter, 
RzsATiPCP) does not seem to possess all the three properties. However, one can try 
to modify the structure of the proof string in such a way, so that it can be shown 
joinable too. 
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